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“i.e., the probability of. taking” a transition to a specific, ‘future perfor- 

, mance ‘state given ‘data pertaining to. the student's ‘ctrrent: performance ° 

’ state. ‘Performance is expréssed in‘terms. of mastery ,\ a theoretical .. _ 
construct “chat is- defined in the paper., “State vectors: indicate ‘éifher °, 
the probability of mastery: or the degree..of tastery, *The current. etate.” 
véctor can be computed Erotr available Sbperved. eriterton fest scores, 2 a 
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and 4 management application of ene, Marlo node}. “are ‘mentioned. ae 
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Griterion-referenced tests are becoaing, a _common metho of gacaestas 


s 
ry 


_ papal performance with reépect to a ‘specified content objective, 


Such 


F 2a 
tests are “intended to provide absolute measures of proficiency. “Accord= 


ing to Cronbach (1969), too much attention has been given to comparati e- 


interpretations and too Little to absolute content-referenced | measur ent. 


2 . - i 4 


‘Kriewall (1969) points out: 


s v 
« 
r 


fic data that can be meaningfully interpreted in the absence of pupil- 


oro data. Hence one needs absolute measures of an individual's profi- | 
ciency with respect to a well-defined Poe oF content « or set of gkiis. 


1 
_ Absolute measures of an individual's proficiency can . aid baie teacher 


. in naktng ‘decisions that . are intended to improve | subsequent papi perfér- 


] 


- « » what is required to “guide instructional decisiaqns is curr culum; 


mance e 


s 


Lf criterion test scores are “used for itetructtona® ieet tons 


om 


4 . . 1 


: of an ‘ordered set of 


making, a “method of predicting pertonmence on. subsequent tests may ba of ; 


fi 
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considerable value; wae when (a) + .the instructional program consists 


its and (b) cect) unit has a set of subob jgetives 


“that are related to the program i aaa The erediceton model presented 
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ws 


in thts paper was developed apart 
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include eriteridn~referdnced” tale 


G 


B 


« 


‘ 


Z ‘ re) 


a for instructionet programs which 


a a _ Using a prediction, model, 4 "teacher. may weliade inatructional activ~- 


’ 


r 


ities’ that appear, to have 2 high Denote for improving predicted £4 


‘mance of’ subsequent wntté, of, ‘instruction. ‘Without a prediction model, 


Y 


" the teacher dgsiring ‘£0 ‘improve subaequent sex eoniance must use performance 


we’ 


aa T units ‘of instruction. for. which observed scores _are avai Jable. ‘ The 
Cc eects _ ‘ab { ve? 


ee aimed at ‘improving predicted performance on subsequent units, 


of instruction is seldom used, “not because it hes been ineffective, but 9 
x 


because it requires | a reliable predié¢tion model? ‘that ig convenient to 


- « “7 @ 
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.. use, ae CO 
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Definition of Terms 
——S 


Before discussing the eisns model, the following terms need . a 


to be defined: mastery, probability of mastery, degree of mastery, — 


" state vectors,- and transition, matrix.’ 6 


- 
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Mastery is a theoretical construct jueed-to represent the smaxLinuth | seg ” . 
performance level, for a specified content objective when performance is 
: / ot 
measured with a criterion test siieh makes no assessment erfors. A N ro 


_» . » item test which makes no assessment errors would resiilt in an - obseitved: “Sys 


oe : score of N for. all gtidenes who are in the total mastery state; alan _ 


a eo . . ait 3 - ™ 
total hon-mastery ‘state. : ; ; : ee 3 : 
ane types ° assessment errors may occur. ' Type I errors oceur when 


‘ 


a student who has mastered, an ‘outcome answers some of the items incorrect~ 


‘ ly. Type II errors occur on a student who has notYmagtered the objec- 
\ 
, tive answers some of the tenis correctly. Carelessness is likely to~ 


_— result “in Type I errors; pies ine is eri to result “in Type II errors: 
— . ee 


‘Both epee ‘of errors may also ‘pesate when criterion test performance is ~N 


: not dependent solely én the specified content objectives for which the 


as a 8 aa . 


fest was intended, - ~ a Vo. * 


~, ae . i ss \ \. 
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‘Since ‘criterion -tests which make no assessment errors cannot be 


i , constructed, obaerved scores are not Gouipletely reliable indicators of * 
the student's true performance state. Observed scores can ‘be ebuvaneadt \ 

however, to values whlch ake Sete: of performance relative to mastery 

: _ % . or non-mastery; two such Jwlues are probability of mastery, PM), and 

degree of ‘mastery, D(M). When probability of mastery is used to répresent 

“gulterion performance, it is assumed that each student is in either the ‘ 

i “. total mastery state or the total non-mastery state, Probability of mas~ 

y ° tery, tigtatore, is a measure of confidence that a student is in the 

o* total flastery state, : On the other hand, when degree of mastery is used : ; 


1 


to represent criterion performance, it is assumed that students can be 


; Vein any state along a continuum from total mastery to total non-mastery, ri 
. @ = Degree of mastery, therefore, is an estimate of how close a student is 
: « te ‘ —. 
c. to the total mastery state. In this paper both probability of mastery 


and degree Of mastery will be represented by a number between zero and 
‘ » a? . 2 te 


one. Methods of computing degree 6f mastery\ and probability of mastery ya 


° : o methods.- 
; : / / +) 
~~ “It may be possible to assume a probability \of mastery equal to one 
for all degree of mastery scores greater than or equal to.a specified — . 
a“ ‘eriterjjon value and a memo of mastery equal to zero for all degree ' 
‘ , % 4 . : a 
of mastery scores less than the’ specified criterion value. Such an- . : . 


s * - “et j 
ass on is not unreasonable if .(a) the criterion test doés not make 


, + « 
4 - ’ 
“ 


too many assessment errors; and (b) an oo "cutting score” can 
* iN ; a ee . 
ss . 


{ 7 1 . . 


be determined, | The predtetton: moder presented in this. paper does. not ie 


: require cutting scores. to-be aétectea, 


State vectors represent eriterion performance, ata specified point 


in thie fee. a: erate or group of students. A state, vector - (v) is a 


oo 


‘ifunction of probability of ‘iances or degree of ankers: Mathematically, 


\ ad lak wt 
‘the state vector-for unit i is defined as follows: , #8 so 


4 


\ \9 é. 
where M. and M, represent values indicative, of performance relative to 
iv 
mastery and non-mastery ‘respectively; CoBes + BAD and 1-P(M) for unit i. 


wurzent state vectors. Ww, ) exist for all units of instruction that ‘have 


been completed: ‘Fature state vectors We ) can be calculated by using . eae 


3” 


-_one current state vector and the appropriate transition matrix (1)... 


* Transition matrices indicate the probability of a specific perfor- 
<,f « 


_ usted state accer completing unit | given knowledge about performance on 
: a criterion test “for unit i., Using the ‘Rotation P cL, /X, ) to represent 


‘the conditional probability of state Y after i al unit 7 given 
\ . - 
that |the student was in state x after completing unit i, “the mathematical 


definition ‘of the grenetiion matrix Thy is as follows. - 8 

5. : = : \ » 
% 7 ° 
i 


> ‘h a = ij = ie rm , 
' eo ? aac 
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where M represents MBA PeEys ii,- non-mastery; POM, /M M,) sigeia 1-P Gi, /i, )3 


‘=.. and PGi,)i,) equate 15% ). 


- Methods: of Computing Transition Probabilities :- / 


ae eee : . a“ “s ee 
, é- 


. A variety of fiethods can be used to compute the conatectonat prone. 


bilities, depending: on the data available and ‘the assumptions nade, . 


For eximple, if N students are classified fii either the mastery or ‘none 


mastery state for units i and 4, Fhen ‘ counting procedure can be used 


to determine the frequencies sige abe wth each. transition path; 


woe 


fee; F(M, » ¥,)» FM; M,), FM, , . ¥,) and ‘F(M,, M,). These ‘frequencies 


* can then be used to ‘compute the conditional probabilities. The mathemat~ 


ical equations are as follows: 


. Pei, i) )= ri, M,)/FM, ) 

“ "PM, /M,) = FG, M,)/F M,) n° | a 
Gym) = FM,, H,)/FQ4,) * _ ; 
Py d= FO, )/EK,) ; 


hate FM, ) equals F(M,;,°M,) rd FM, M,) and FM,) equals F(M,, M,) te 


FO, My). : . : has , UN - ; 
tf probability of mastery, P(M), and probability of Gomraantery, 
PM), are assumed ag be either zero or one, an eanbverent set of aauétfons 


can be ompreiae? for a group of N students: - : ‘g 


—_ 7 a eae 7) , 
, POH, /M = P(M,) P(M,) : a 
* Pit —_— : ° . ‘ : 5 
— i iA . 2 
PM, Mi, ) = . P(M,) P(M,) : - ; 
- SS Pat) Pat) oe 


— =" | 
= mee 2) : ee 
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If it fs not apoined t that | PO i ind a ate. either zero or one, the ana 
“y N t x 1 j : "hp ‘ a . ‘ 


equations can be ceed to compute transition matrices that may be more .,, ont, 


reliable for a future ‘state vactarss 
] 


and fwo were 4, Fy (2, 5 and. YG, 3), i ‘repectively:. = 
, . 3 F he 
Exaiple: ‘1 5 : : as . 5 ‘ee : ° a “ a $ 
nS sar 2 an 7 eer : a i Z + x . 
=. Assume that an, pbadives Score, of 4 or 5 ace bina j ae ee 
5 . = , . - - * - 
wee observed score - less: than 4 indicates ton-mastery.. an refore,. og 


’ 
] 
t 
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oe the required frequency counts are. as. follows: i 3a 


oe : Se , a Ct, ? 


“The conditional penser: are indicated in the Zot lowing: transition ‘ 


+ ‘ , . ‘ to ie ; t 


aberis: ; : , 4 : cae x ten” . . ; " ; 


| ft. (| POLY PGi, /) : 
. | . "Ty ~ _ ; . - | -s " oo ‘ ; 
a 228 7 PM,/) PM) /My) | : 


: me Example ‘9 “ : , ; se ; : : ' . . ‘ ; xe : 


, 


wt Bas \ : ris _ a - | 
“. Assume that the probability of mastery is one for observed 
. . e « ” 
scqres of 4 or 5 and that the probability of mastery-is zero for “i 


: obseryed ‘scores less than 4, The probabilities of mastery and - 
/non-mastery sare, therefore, as follows ‘for the three students: 


* 


_Student ¢ POW) - Pd,) : P(M,) fe P(M,) : : . 


a ©) a a ee 60 os - 
re bee be 7 0 21. OP wae Ee 
5 3 - fy Ot eS Ge a oft 


The following sums are ‘ngeded to compute, conditional probabilities: 


Bie tee ty ee - *% , a ¢ 
>= PM) PQ) = 1 . : é . ; . ae ts 
3 <P os as ut — = 
_— P(M,) P(M, ). bd 0 : 2 ; . t = ’ F 
= 3 | < . 7 : ve , . : SS 
Pay Pogy tt | . . 
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= Pahipire Me 5 oe 


These values are the samie as those computed previously by the 


4 ~ 


"frequency method. : er . s Z 
= Y = 7 s : of ‘ Pr 


3 oe Mey ‘ aay ia ry 


> Pauy “Nt ae 


t * Assume that values for the: ‘probability. of. méstery. can be” : io 
\. ¢ 


compéited for any observed score ‘ftom 0 to 54, . (Appendix A describes 


% 


‘a pionedube for. cofiputing POH), wieve x. is an observed ‘score ae 


wis 


0 to 5. y° For. thas example, the. following values will be used: 


rae 


. ie : a 7 - aa / : -. : a : _ _ a 
student #PQG) PO) P(M;) =. 'PQM,) a 


ek 0,800" 0,20... 1,00> 0,00." 


a 


oe i, rn oat _ i 
ia 2 0.90 “0830 + - 0.70: 
4 3 ap 980-7 a ‘onto 0,30 0.80 


the ‘foloving. sme are obtained for the probabilities shown: a 


* e S - 
* as, BY y * - ee aus 


‘4 3. ‘ oe = ee 7) 4 . - ‘ oe 
- SS -p Ar. «ap Fa \ op te ar \ ’ é 
Sra 2G = ee es, otk : " ae os » ‘ . 


= ~ r 


= Pt) ae = 6.49... ee ee 


1 3 : = . i 
Sr ays 0.79  * .  s os 


= re 70) = 


de 3. d < 
= ro) = i, 80. 


. 


Py 


Gift = 0.71/1.20 = 0,59" 


Pe 3) = he 0349/1. 20. = id , 


ame -& - 7 . 
PA 
phy). 1,01/1,80 = 0.56, oa 4 


“it, should be noted that the probabilities ‘computed in this aianede | 


* ~ . o 


Ma, 


Pei 


: ‘ differ from the warts obtained in one previous Go amped 
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‘The Markov. Prediction Model 


‘ 
x © 


wv 


one ; . 
The Markov ee future state vectors “for a 


. 
‘ 4 


_ student to. be predicted using a single Cuiréat’ state Vector and ehe 
i ales eS os On ere rea 


. oe ° tr 


‘ appropriate transition matrix, Transition probabilities are baped ON | an. 


‘test scores’ obtained for a sample of students who have previously | 
. Ni 


< x «a e 


completed the necessary units of instruction.. “Mathematically, eneees 


* wee 6 


diction nodel is, represented by thé, following mattix: equation: 


ee 
. 


™ eae Ege ’ : : ‘ar 
where Vey is the future state vector for unit 35°V cl, is the current aa ; 
vector ‘for unit i, and T Ty is the- transition matrix’ from ‘unit 2 to unit j. 
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¥ , : 
% © ‘ € 


sp equals i + ihe, Thy T. 93?" 542 and*so on. To obtain the matxix nd 
, “ 


ol Thy? ie k £6, greater than ones requires a eatees of matiix sinkipiicn 


v a 


tion operations. For example, T 14 fis equal to a : toa) « 34° To ‘ ” 2 


& ee ” e o. ~ . 1 \ - 
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6 ee Te ordee to liustrate how. the Markov model gat be. used to predict ye 


<3 Pre ae “o 
fe P23 SAE Sos. a 


" future performance ¢ on. a criterion. test, the. ‘future's atate a will be + es a 


- ‘eouptitea uote the matrices, 2 2 ye Hg “and ae for a _ student whose prob- a 


“ae a 


. . ae bly ot mastery. on the fiat ‘unit is 0. 8. The caidulations areas = 


“4 - -- 


44329. 352] 2 


i lenses 


STL. S e 


st ae . . ; ; 
The futfré. state vestry “indicate that ‘the probability of mastery 1 is ' 
ce 


‘ oe 5 - 4 


‘ LO 0.68 fort ait o 0. 674 ‘for’ unite 3, ad Oe 6686 for unit 4. I€ should be - 
‘ _notatte as ‘probability of mastery for ‘unit 2 will vary between 0.6 : 
” and 0, - To matter what ao sae peopebeiity of mastery was for a . .* 
: unit a | A _ | a 4, 3 ee eS . - Fe, 
. . | - aka : . a of the Markov Model .~ 4 ° 


®, 


| : oe) ae One : of the ‘moat enact applications of the Matkov model is in 


4 


predicting the. effects of various instructional sequences om subsequent 


A yrs 


- perfoimance, ‘suppose, for example, that transition matrices haw been - * : 


“computed siden are based on two different methods of “presgribing, second 


~y 


instruction, 2 and Pye Since one péescription method may not be the 
ye é 


_ most effective method for all ‘units’ of instruction, the Prcotes is to 


io = 


» find, a sequence that results in the highest probability of mastery 


based on a woabees’ $0r the instructional program, there are gi0 (or 


a 1028) possible seeerintion sequences that would have to be tried in 
oder to” determine the optimum sequence. One approach to the problem 
“would be ‘to use “the Markov moder to predict posttest performayce for all 


Possible preser!ption sequences using a computer and then select thogé 


zegvencee that result in the nighase probability of ag a the selected: 
sequences een, Puen be evaluated with a expérinental design. has Bay : ; ‘S, 


-A second application pertains to a selection of an optiiial Yeét sion 


“~ 


BEEBESgy In business, the ‘ibeens question arises: | Should decisions 
. ihe made to maximize current profits or to maxititze future’ profits? In 
: education, a giailex question arises; ‘Should ingtructional prescriptions 
Ce selected to maximize current performance relative to unit objectives 
or > to maximize future performance relative, £0 end-of-progran, objectives? 
A. markov model enabree preser{ptions to ‘be based on a ecesheny which 


a: 


inaxcinit ges future predicted performance. The method may be aveluated by 


4 


comparing ‘it with a strategy that maximizes current performance, Evalua- 


> tion of the two _Peguertption methods would likely sewdiva a direct com-* 


parison of actual. posttest performance, 
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